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Real Party in Interest 



The Real Party in Interest is SONY Corporation and SONY Electronics, Inc., the 
assignee of record. 
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Related Appeals and Interference 



There are no related appeals and interferences. 
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Status of Claims 



Claims 1-8 and 14-22 are pending in the present application. Claims 9-13 are 
canceled, claims 1-8 and 14-22 are on appeal. 
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Status of Amendments 



Applicants have filed an amendment with this appeal brief. The amendment is to 
claim 1 8. The amendment has not been acted upon by the examiner. 
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Summary of Claimed Subject Matter 

Annotation information may be stored in association with selected frames in a 
plurality of frames of a production. See Specification, page 5, par. 31. An annotation 
marker may be displayed in a frame when a frame is displayed during playback of the 
plurality of frames. See Fig. 1A and specification, page 5, par. 32 and 32. 

The annotation markers show a visual relationship of the annotation information's 
relevance to the frame. For example, the annotation marker may tell the user that the 
annotation is intended to relate to the frame underlying the annotation marker only or that 
the associated annotation may be most relevant to the underlying frame. Also, the 
annotation marker may be a dot with a forward-pointing arrow to indicate that the 
annotation is pertinent to this frame and onward through the plurality of frames. Other 
visual relationships may also be appreciated. See specification page 5, par. 33. 
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Grounds of Rejection to be Reviewed on Appeal 



1 . Whether claim 1 8 is unpatentable under 35 U.S.C. § 1 12. 

2. Whether claims 1-8 and 14-22 are unpatentable over Matsuzawa et al (U.S. 
Patent No. 6,085,185, hereinafter "Matsuzawa") under 35 U.S.C. §102(e). 
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Argument 

Section 1 12 Rejections 
Claiml8 

In an amendment after final, Applicants have amended claim 1 8 to read 
"an action". Applicants submit that claim 18, as amended, now complies with the 
requirements of Section 112. 

Section 102 Rejections 

Claims 1 and 19 

Claim 1 was rejected under 35 U.S.C. §102 as being anticipated by 
Matsuzawa. Applicants submit that Matsuzawa fails to disclose or suggest that an 
annotation marker is displayed with the frame when the frame is displayed during 
playback of the plurality of frames in the production, the annotation marker showing a 
visual relationship of the annotation information's relevance to the frame. 

The final rejection stated that Matsuzawa discloses that a user puts an 
annotation to a specific range of a medium and the system registers an annotation object 
comprising the object ID of the target medium, specific range, and annotation 
information in a table. Figs. 4-5 in Matsuzawa as referenced in the final rejection show a 
table that is storing the annotation information. This table may be stored and may be 
later viewed. However, applicants submit this does not disclose or suggest that the 
annotation markers are displayed with the frame when the frame is displayed during 
playback of the plurality of frames in the production . Matsuzawa is directed towards the 
retrieval of recording material without requiring manual steps. See Matsuzawa, col. 2, 
lines 22-27. What is shown in Figs. 4-5 is a table that is created to summarize the 
annotation information. This table is not the production of frames nor is it displayed 
during playback of the plurality of frames. 
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The table may include a range of values for frames. However, this table is 
not shown during playback of the plurality of frames. Rather, Matsuzawa might retrieve 
the range of frames and play them back. As shown in Fig. 4, the table shows a range in 
columns 703 and 704. However, this table is not used when playback of a production is 
performed. 

Also, Fig. 5 shows a thumbnail in the table. However, this thumbnail is 
extracted from the video. See Matsuzawa, Fig. 17. Thus, the annotation information is 
not displayed during playback of the production. 

Also, Matsuzawa does not disclose or suggest the annotation marker 
shows a visual relationship of the annotation information's relevance to the frame. Fig. 5 
and 17 are cited in the final office action as disclosing this element. Fig. 5 in Matsuzawa 
shows a table and fig. 17 shows an extraction process. There is no visual information that 
shows the relevance to the frame in Figs. 5 and 1 7. Fig. 5 shows an annotation 
management table. The table does not include annotation information that would show a 
visual relationship when displayed with the frame during playback of the frame. In fact, 
the annotation information shown in the table is not displayed with the thumbnail during 
playback. Even if the table is considered playback of the thumbnail (it is not), the 
information does not show a visual relationship of the annotation information's relevance 
to the frame. As described in the specification in paragraphs 31-34, the annotation 
marker tells a user how the annotation information is intended to relate to the frame 
underlying the annotation marker displayed. For example, in embodiments of the present 
invention, the annotation marker may indicate that the annotation information is only 
relevant to the underlying frame. Also, the annotation marker may indicate that the 
annotation information may be relevant to the underlying frame and also additional 
frames, such as frames subsequent to the underlying frame. In one embodiment, the 
visual information may be a dot with a forward-pointing arrow to indicate that the 
annotation is pertinent to this frame and onward through the plurality of frames. Other 
visual relationships may also be appreciated. Accordingly, Matsuzawa does not disclose 
or suggest a visual relationship as claimed. 
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Applicants submit that claim 19 should be allowable for at least a similar 
rationale as discussed with respect to claim 1 . 

Claim 14 

Matsuzawa does not disclose or suggest that the annotation marker is 
stored as part of the frame in the production. The final rejection states that Figs, 1-6 and 
col. 4, lines 30-3 1 disclose this element Figs. 1-6 show tables that may be stored in 
media. However, applicants submit that this does not disclose or suggest that the 
annotation marker is stored as part of the frame in the production . Rather, these tables 
are separate from the frames of the production. Also, these tables are used to retrieve 
parts of the production and are not part of the production. See Matsuzawa, col. 2, lines 
22-27. Thus the annotation information is not stored as part of the frame in the 
production. Also, in Fig. 5, a thumbnail may be stored in the table. However, this is not 
storing an annotation marker as part of the frame in the production. As claimed, the 
annotation information is part of the information that makes up the frame. 

Claim IS 

Matsuzawa does not disclose or suggest that the annotation marker is 
displayed in the frame being displayed. The rejection states that Figs. 2-6 and 17 disclose 
this element. Figs. 2-6 of Matsuzawa show tables that include annotation information. 
Fig. 17 is a flow chart for extracting thumbnails. Nowhere in these figures is it disclosed 
or suggested that the annotation marker is displayed in the frame being displayed. As 
shown in Fig. 5, the thumbnail is shown in a column 706. None of the annotation 
information in the table is displayed in the thumbnail. If the thumbnail was a picture, 
then the annotation information would be displayed in the picture. Matsuzawa does not 
disclose or suggest this. 
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Claims 2-8 and 14-18 and 20-22 



Applicants submit that claims 2-8 and 14-18 and 20-22 depend from 



claims 1 and 19 and thus derive patentability at least therefrom. 



Respectfully submitted, 



TRELLIS INTELLECTUAL 
PROPBfOlHAW GROUP, PC 




B y! 

Brian NTYoung 
Reg. No. 48,602 
Tel.: 650-842-0300 
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ting of Claims; 



Claims Appendix 



1. (Previously presented) A method for annotating an item in a user 
interface of a media production system, the method comprising 

accepting signals from a user input device to select a frame in a plurality 
of frames of a production being processed by the media production system; 

creating annotation information and an annotation marker; and 
storing the annotation information in association with the selected frame 
of the production, wherein the annotation marker is displayed with the frame when the 
frame is displayed during playback of the plurality of frames in the production, the 
annotation marker showing a visual relationship of the annotation information's 
relevance to the frame. 

2. (original) The method of Claim 1, further comprising 
accepting signals form a user input device to create the annotation 

information. 

3. (Previously presented) The method of Claim 2, wherein the annotation 
information includes text information. 

4. (Previously presented) The method of Claim 2, wherein the annotation 
information includes capture of drawing information. 

5. (Previously presented) The method of Claim 2, wherein the annotation 
information includes audio information. 
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6. (original) The method of Claim 1, wherein the annotation information 
is automatically generated by a process executing on a digital system. 

7. (original) The method of Claim 6, further comprising 
wherein the annotation information is automatically generated at a 

predetermined time. 

8. (original) The method of Claim 6, further comprising 

wherein the annotation information is automatically generated upon the 
occurrence a predetermined event. 

9-13. (Canceled) 

14. (Previously presented) The method of claim 1, wherein the 
annotation marker is stored as part of the frame in the production. 

1 5. (Previously presented) The method of claim 1 , wherein the 
annotation marker is displayed in the frame being displayed. 

1 6. (Previously presented) The method of claim 1 , wherein the 
annotation marker indicates one or more additional frames that are relevant to the 
annotation information. 

1 7. (Previously presented) The method of claim 1 , wherein the 
annotation marker is associated with an action that is performed when the annotation 
marker is selected. 

1 8. (Previously presented) The method of claim 1 , wherein the action 
comprises displaying the annotation information. 
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19. (Previously presented) A method for displaying a production in a 
user interface of a media production system, the method comprising 

during playback of the production, wherein the production includes a 
plurality of frames, determining when an annotation marker is associated with a frame in 
the plurality of frames; 

displaying the frame and the annotation marker, wherein the annotation 
marker shows a visual relationship of annotation information's relevance to the frame; 

receiving an input selecting the annotation marker; and 

performing an action with the annotation information in response to the 
selecting of the annotation marker. 

20. (Previously presented) The method of claim 19, wherein the 
action comprises displaying the annotation information. 

2 1 . (Previously presented) The method of claim 19, wherein the 
annotation marker indicates one or more additional frames that are relevant to the 
annotation marker. 

22. (Previously presented) The method of claim 19, wherein the 
annotation marker is displayed in the frame being displayed. 
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Evidence Appendix 

NONE 
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Related Proceedings Appendix 



NONE 
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